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Abstract 

We suppose the existence of an oracle which is able to solve any semidefinite programming (SDP) 
problem having interior feasible points at both its primal and dual sides. We note that such an oracle 
might not be able to directly solve general SDPs even after certain regularization schemes such as facial 
reduction or Ramana’s dual are applied. The main objective of this work is to fill this gap and to show 
in detail how one can use such an oracle to ‘completely solve’ an arbitrary SDP. Here, we use the term 
to completely solve an SDP to mean a scheme which works in the following way; given an SDP, the 
scheme checks whether it is feasible or not, and whenever feasible, computes its optimal value, and if the 
optimal value is attained, obtains a maximal rank optimal solution. If the optimal value is not attained, 
computes a feasible solution whose objective value is arbitrarily close to the optimal value. Moreover, if 
the original SDP is infeasible, it distinguishes between strong and weak infeasibility, and in the case of 
weak infeasibility, can compute a point in the corresponding affine space whose distance to the positive 
semidefinite cone is less than an arbitrary small given positive number. 


1 Introduction 


Consider the following pair of primal and dual conic linear programs. 


inf 

(c, x) 

X 

subject to 

Ax = b 

x £ K, 

sup 

(b,y) 

V 

subject to 

c~ A T y 


(P) 


(D) 


where K. C R n is a closed convex cone and 1C* is the dual cone {s € R“ (s,x) > 0,\/x £ K,}. We have 
that A : R" —>• R m is a linear map, b £ R m , c £ M” and A T denotes the adjoint map. We also have 
A 1 y = Yl'iLi AiVi, for certain elements Ai £ R”. The inner product is denoted by (.,.). We will also use 
the notation (1C, A, b, c) to refer to the pair m, <0. 

In this article, we are mainly interested in the case where !C = <S?, where <S" is the cone of n x n 
symmetric positive semidefinite matrices. In this case, A is a map from S n to R m , where S n is the space of 
n x n symmetric matrices and (c, x) = trac e(cx). 
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Interior point methods (IPMs) [151 12 are one of the standard methods for solving semidefinite programs 
(<S", A, b, c). However, in order to function properly, they require that the problem at hand satisfy certain 
regularity conditions which may fail to be satisfied and this leads to numerical difficulties. The usual 
requirement is that there is a primal feasible solution x such that x is positive definite and that there is a 
dual feasible solution y such that the corresponding slack s = c — A T y is positive definite. In other words, 
Slater’s condition must hold for both m and ©. In this article, we suppose the existence of an idealized 
machine that is able to solve any SDP having primal and dual interior feasible points and discuss whether 
it could be used to solve other SDPs which might not satisfy that assumption. In this paper, we use the 
expression that an algorithm or a scheme completely solves SDP when it works in the following way. 

1. It checks whether the SDP is feasible or not. 

2. When the SDP is feasible, it computes the optimal value. If the optimal value is attained, it computes 
a maximal rank optimal solution. Moreover, if the optimal value is not attained, given arbitrary small 
e > 0, it can compute a feasible point whose objective value is within e distance of the optimal value. 

3. When the SDP is infeasible, it distinguishes whether it is strongly infeasible, or weakly infeasible. 
Whenever the SDP is strongly infeasible, it computes a certificate of infeasibility. If the SDP is weakly 
infeasible, then it can compute a point in the corresponding affine space whose distance to the positive 
semidefinite cone is less than an arbitrary small given positive number. 

First, we will explain why this is a non-trivial task while connecting to previous research on conic linear 
programming. 

• Interior point algorithms and software. Most modern IPM softwares [2(31. [8J [233 do not require explicit 
knowledge of an interior feasible point beforehand. SeDuMi [25] . for instance, transforms a standard 
form problem into the so-called homogeneous self-dual formulation, which has a trivial starting point. 
SDPA and SDPT3 [25J use an infeasible interior point method. The fact that these methods can 
work without explicit knowledge of an interior feasible point, does not mean that they do not require 
the existence of an interior feasible point. Quite the opposite, the absence of interior feasible points 
may introduce theoretical and numerical difficulties in recovering a solution for the original problem. 
Also, detection of infeasibility is a complicated task. Some interior point methods, such as the one 
discussed in m by Nesterov, Todd and Ye, are able to obtain a certificate of infeasibility if the problem 
is dual or primal strongly infeasible, but the situation is less clear in the presence of weak infeasibility. 

• Ramana’s extended dual. When neither the primal nor the dual have interior feasible points, there 
could be a nonzero duality gap between the m and m- To address this, Ramana [23 [MI developed 
an alternative dual for m that requires no regularity assumptions for the case K. = <S". Remarkable 
features of Ramana’s dual include the fact that it can be written as a SDP, always affords zero duality 
gap and that the dual is always attained whenever the primal optimal value is finite. However, Ra¬ 
mana’s dual is not necessarily suitable to be used with IPMs due to the fact that it does not ensure 
the existence of interior feasible points at both sides. 

• Facial reduction. Let in be the minimal face of <S" which contains the feasible slacks of JD])- If 
we substitute <S" for in JD]), then JD]) will have a relative interior slack. This means that if the 
(Lagrangian) primal problem is computed with respect to instead of <S", Slater’s condition will be 
satisfied and there will be no duality gap. The process of finding T^ in is called facial reduction GUCES] 
and was developed originally by Borwein and Wolkowicz 012 . However, one important point is that 
although there is a dual relative interior, there is no guarantee that there will be a primal relative 
interior feasible point. So, again, even this regularized problem might fail to have interior solutions at 
both sides. 

There is a growing body of research aimed at understanding SDPs having pathological behaviours such 
as nonzero duality gaps and weak infeasibility. Here we will mention a few of them. A problem is said to be 
weakly infeasible if there is no feasible solution but the distance between the underlying affine space and the 
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cone under consideration is zero. Weak infeasibility is known to be very hard to detect numerically, see for 
instance Polik and Terlaky [21]. In j30] , Waki showed that weakly infeasible problems sometimes arise from 
polynomial optimization. There is also a discussion on weak infeasibility in the context of SDPs in [12], where 
the authors introduce the notion of hyper feasible partitions and show that for weakly infeasible problems 
at most n — 1 directions are needed to construct points close to 5" and that belong to the underlying affine 
space defined by the problem. Hyper feasible partitions have many interesting properties and they can be 
used to find smaller problems that almost preserve the feasibility status of a given problem, see Theorem 
\m The result on the number of directions was recently generalized to arbitrary closed convex cones by Liu 
and Pataki, see m for more details. 

It is hard to obtain finite certificates of infeasibility for SDPs, because Farkas’ Lemma does not hold 
in general for non-polyhedral cones. The first finite certificate was obtained by Ramana in [231 . Since 
then, Sturm mentioned the possibility of obtaining a finite certificate for infeasibility by using the directions 
produced in his regularization procedure, see page 1243 of [27] . More recently, Liu and Pataki have also 
obtained finite certificates through elementary reformulations |IT. Interestingly, Klep and Schweighofer [9] 
also obtained certificates through a completely different approach using tools from real algebraic geometry. 

In [32], Waki, Nakata and Muramatsu discussed SDP instances for which known solvers failed to obtain 
the correct answer and in one case, this happened even though the problem had an interior feasible point at 
the primal side. In |T5] , Pataki gave a definition of “bad behaviour” and showed that all SDPs in that class 
can be put in the same form, after performing an elementary reformulation. A discussion on duality gaps 
and many interesting examples of pathological SDPs are given by Tungel and Wolkowicz in [291 . 

The fact is that, in general, SDPs can display several nasty behaviors and this stands in sharp contrast 
to the relatively nice nature of SDPs having primal and dual interior feasible points. The main goal of this 
paper is to show that a SDP can be completely solved by considering a finite sequence of very well behaved 
problems. In particular, we demonstrate that it is possible to further regularize a SDP after facial reduction 
is done. By doing so, we can convert a strongly feasible SDP with possibly weakly feasible dual to another 
one satisfying strong feasibility at both sides without changing the optimal value. This is one of the main 
contribution of the paper and is treated in Section [5] We also make it clear that facial reduction can be 
performed by solving nice SDPs with primal and dual interior feasible points. This was already discussed by 
Cheung, Schurr and Wolkowicz [6], but it is a point which had not been emphasized much in the literature. In 
our context, this facet of facial reduction is critically important. Therefore, for the sake of self-containment, 
we deal with this issue in more detail in Section [3] 

This work is organized as follows. In Section [2] we review a few basic notions and also facial reduction. 
In Section [3] we define the interior point oracle and discuss a version of facial reduction for SDPs. In Section 
[4] we recall some properties of hyper feasible partitions and show how they can be constructed with the 
interior point oracle. Section [5] shows how to compute the optimal value and in Section E we discuss how 
to check if the value is attained or not. Section [3 shows a complete list of steps for completely solving (iDl) 
and in Section [5] we compare our approach with previous works. Section [9] wraps up this paper. 


2 Preliminary discussion and review of relevant notions 

Let C be a closed convex set. Its relative interior, closure and relative boundary are denoted by ri C, clC 
and relbd C , respectively. For 1C a closed convex cone, we denote by lin /C the largest subspace contained in 
1C. A convex subset T of 1C is said to be a face of K, if the condition “a, b £ 1C, £ J 7 ” implies a,b £ T. 

Given a conic linear program (/C, A, b , c), we will denote by Op and Op, the primal and dual optimal values, 
respectively. It is understood that Op = +oo if (0 is infeasible and Op, = — oo if m is infeasible. The pair 
0 and m is said to have zero duality gap if Op = Op,. The primal and dual feasible regions are defined as 
follows: 


T\> = {x £ R ra | Ax = b, x £ /C} 

Jb ={yC | c~A T y £ 1C*} 

= {s £ 1C* | 3y £ R m , s = c - A T y}, 
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where an element s G Pp is said to be a dual slack. The dual optimal value Op is said to be attained if 
there is a dual feasible y G Fb such that (b, y) = On- The notion of primal attainment is analogous. We 
recall the following basic constraint qualification. 

Proposition 1 (Slater). Let (K.,A,b,c) be a conic linear program. 

i. If there exists x G ri/CnFp , then Op = Op. In addition, if Op > —oo holds as well then the dual optimal 
value is attained. 

ii. If there exists s G Pp Ori/C*, then Op = Op. In addition, if Op < +oo holds as well, the primal optimal 
value is attained. 

For the reader’s convenience, before we proceed we recall a few basic facts from convex analysis. 
Lemma 2. Let /C be a closed convex cone, X G ri/C, x G /C and z G 1C *. 

i. 1C** = 1C. 

ii. lin/C = 1C* 1 -, where 1C* 1 - is a short-hand for for (1C*) 1 -. 

Hi. x +X G ri/C. 

iv. There exists a > 1 such that aX + (1 — a)x G 1C. 
v. z G 1C 1 - if and only if (X , z) = 0. 

Proof. i. This is the famous bipolar theorem, see Theorem 14.1 of [25] . 

ii. If z G lin/C, then (z,y) > 0 and (— z,y) > 0, for every y G 1C*. It follows that z G 1C* 1 -. Reciprocally, if 
z G 1C* 1 -, then z G 1C** = 1C, by the bipolar theorem. Since 1C* 1 - is a subspace, we have 1C* 1 - C lin/C. 

Hi. Since I G ri 1C, for any z G 1C we have that all points in the relative interior of the line segment connecting 
z and X also belong to the relative interior of 1C, see Theorem 6.1 of [25] . Since x + X = X\ + (2x + X)-^, 
we have x + X G ri 1C. 

iv. See Theorem 6.4 of [25] . 

v. If 2 G 1C 1 -, it is clear that (X,z) is zero. Now, suppose that (X,z) is zero. By item iv, there is 
a > 1 such that aX + (1 — a)x G 1C. On one hand, since z € 1C* , we have (u, z) > 0. On the other, 
(u,z) = (1 — a)(x,z ) < 0. So, we must have (x,z) = 0. As x is an arbitrary element, it holds that 
z G 1C 1 -. 

□ 

It is a consequence of classical separation theorems that existence of a primal relative interior feasible 
point can be translated to a statement about the dual problem. We recall that if C\ and C 2 are two non¬ 
empty convex sets then ri C\ 0 ri C 2 = 0 if and only if C\ and C 2 can be properly separated [25,, Theorem 
11.3]. Two convex sets are said to be properly separated if there is some hyperplane such that the sets are 
contained in opposite closed half-spaces and at least one of them is not entirely contained in the hyperplane. 
Moreover, if C\ is polyhedral and C\ fl ri C 2 = 0 we can ensure that the separation can be done in such a 
way that C 2 is not contained in the hyperplane [23] Theorem 20.2]. This leads to the following fact, which 
can be used as an indirect way of showing existence of relative interior feasible points, see also Lemma 3.2 
in [31] . 

Proposition 3. Let (1C, A, b, c) be a conic linear program. 

i. Suppose that there exists some x (not necessarily feasible) such that Ax = b. Then, ri/C l~l Pp ^ 0 if 
and only if the following conditions hold at the same time: 

(b, y) = 0 and - A T y G 1C* =► -A T y G 1C ± . 

{y I (b,y) > 0, —A T y G /C*} = 0 


4 


(1) 

( 2 ) 


ii. The condition ri 1C* fl J ^ 0 holds if and only if the following two conditions hold at the same time: 

(c, x) = 0 and Ax = 0 and x £ 1C => x £ lin/C. (3) 

{x | (c, x) < 0, Ax = 0, x £ 1C} = 0 (4) 

Proof. i. We first show that if Conditions or © fail to hold then 0 cannot have a relative interior 
solution. If the latter fails, then 0 is infeasible. Now suppose that the former fails to hold and let y be 

such that ( b , y) = 0, —A T y £ 1C* but —A T y ^ /CA Then, if x £ Tp , we have (— A T y , x) = —(y, b) = 0. 

Since —A T y /C^, x cannot be a relative interior point, due to item v. of Lemma [ 2 ] 

To conclude, we show that if ri/C H J -p = 0, then at least one of © or m must fail. The condition 
ri/Cfl J-p = 0 holds if and only if the nonempty polyhedral set C = {x \ Ax = b} and /C can be properly 
separated. Proper separation implies the existence of a nonzero s £ R" and 7 £ R such that 

(s, x + d) < 7 < (s, k), (5) 

for every d £ ker.4 and k £ 1C. The only way © can hold is if s £ 1C* fl (ker.4)^ and 7 < 0. Moreover, 
the fact that C is polyhedral and Theorem 20.2 of [25] imply that we can also assume that /C is not 
contained in the hyperplane {x | ( s,x ) = 7 }. Since s £ (kerA) -1 -, there exists some y £ R m such that 
s = —A T y. We then have ( s,x ) = —(b,y) < 0. We then have two cases. If ~{b,y) = 0, then 7 = 0, 
which implies that s IC^i in order for the separation to be proper. This implies that Condition m 
fails to hold. On the other hand, if — ( b,y ) < 0, then Condition (© fails. 

ii. The dual proof is analogous. The condition ri/C* flfp = 0 holds if and only if the polyhedral set 
C = {c — A T y | y £ R m } and 1C* can be properly separated. This implies the existence of x such that 
Ax = 0, x £ K.** and either: i. (c,x) = 0 and x £ 1C*- 1 ; or ii. (c, x) < 0. We also recall that K,** = /C 
and 1C*- 1 = lin/C, by items i. and ii. of LemmaH Thus we can conclude that © and ® are equivalent 
to the existence of a dual relative interior slack. 

□ 

Sometimes, we will be interested solely in the conic feasibility problem, which we will denote by (/C, C, c ). 
This is the problem of seeking a point in the intersection (C + c) fl /C, where C C R n is a vector subspace 
and c £ R ra . There are only four mutually exclusive categories that (/C, £, c) can fall in: 

i. strong feasibility: ri/C fl (£ + c) ^ 0, 
ii. weak feasibility: ri/C (~l (£ + c) = 0, but /C fl (£ + c) 0. 

in. weak infeasibility: /C fl (£ + c) = 0, but the Euclidean distance dist(£ + c, /C) = 0, 
iv. strong infeasibility: dist(£ + c,/C) > 0. 

In view of the above categories, the usual assumption underlying interior point methods amounts to requiring 
both primal and dual strong feasibility. This is also equivalent to, for instance, the existence of a primal 
interior feasible point together with boundness of the level sets of the primal objective function, see Propo¬ 
sition [3] As a convention, if a feasibility problem is formulated as the problem of finding a x satisfying both 
Ax = b and x £ 1C but the linear system Ax = b has no solution, we will say that it is strongly infeasible. 
We have the following well-known characterization of strong infeasibility. 

Proposition 4. i. The primal © is strongly infeasible if and only if there is no solution to the linear 
system Ax = b or if there exists y such that 

(b,y) = 1 and —A T y£lC*. (6) 

ii. The dual is strongly infeasible if and only if there exists x such that 

(c,x) — — 1 and Ax = 0 and x £ 1C (7) 
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Proof. It is a consequence of Theorem 11.4 in [25], which states that two convex sets C\, C 2 can be strongly 
separated if and only if the Euclidean distance between them is positive. Strong separation means that there 
exists a separating hyperplane H and e > 0 such that C\ + eB and C 2 + eB lie in opposite open half-spaces, 
where B is the unit ball. One then proceeds as in the proof of [3] See also Lemma 5 in m- □ 

We also remark the following immediate consequence of Proposition [4] 

Corollary 5. i. If the primal ([P]) is strongly infeasible and the dual (iDl) is feasible, then 9p> — + 00 . 

ii. If the dual is strongly infeasible and the primal is feasible then 9p = — 00 . 

Proof. To prove item i., note that by Proposition [4] strong infeasibility at the primal side implies the 
existence of y such that ( b, y) = 1 and —A T y G 1C*. So, if y is any dual feasible solution then y + ay is also 
feasible for every a > 0 and we can make the objective function value as large as we want. The proof of 
item ii. is analogous. □ 

2.1 Facial Reduction 

In this section, we will briefly discuss facial reduction. Here, we will focus on problems formulated in the 
dual form <0. But it is clear that any analysis carried out for 0 can be translated back to ©■ 

Whenever 0 lacks a relative interior solution, we may reformulate 0 over a lower dimensional face of 
1C*. The basis for this idea is contained in Proposition [3] the absence of a dual interior solution is equivalent 
to the existence of an x satisfying (c, x) < 0 and x G ker A f~l 1C such that one of the two alternatives is 
satisfied: i. (c,x) < 0, in which case 0 is infeasible; ii. (c,x) = 0 and x 0 1C* 1 - = lin/C, in which case 
J’q C /C*n{a;}- L C 1C*, because (c, x) = (c — A T y, x) = 0 for y G Pc . Note that P 2 = 1C* fl{a;} 1 - is a proper 
face of 1C*, since x lin K. We can then reformulate 0 as a problem over P 2 , that is, we consider the 
problem sup{(6, y) | c — A T y G Jb}- It is clear that as long as ri P 2 fl (p£ ) = 0, we can repeat this process 
and either descend to a smaller face of 1C* or declare infeasibility. After a few iterations, we will end with 
either some face Pi such that ri Pi fl ( P% ) ^ 0 or we will eventually find out that the problem is infeasible, 
in this case Pi = 0. Note that Pi must be the smallest face P^ in of 1C* which contains P . This process 
is called facial reduction and it aims at finding P® in . The direction x will be henceforth called a reducing 
direction. If there is no dual feasible solution, we have P^in = 0. The minimal face also has the following 
well-known characterization, see for instance, Proposition 3.2.2 in m- 

Proposition 6. Let P be a face of 1C* containing P^ . Then the conditions below are equivalent, 
i. Pp fl ri P ^ 0. 
ii. ri pf) C ri P. 

Hi. P = p£ in . 

Facial reduction is a very powerful procedure and it can be used to solve feasibility problems over arbitrary 
closed convex cones. What is troublesome about it is that searching for x could be, in principle, as hard as 
solving the original problem itself. However, an important point is that it is possible to carefully formulate 
the problem of seeking a; as a linear conic program having relative interior feasible points at both its primal 
and dual sides, as we will do in Section [3] Another alternative is to relax the search criteria in order to make 
the problem of finding x more tractable at the cost of, perhaps, settling for a face other than P^ in , as in the 
Partial Facial Reduction approach of Permenter and Parrilo [ZD] . 

One of the problems with facial reduction is that even if we find some face for which the reduced system 
is strongly feasible, there is no guarantee that the corresponding primal will also be strongly feasible. That 
is, facial reduction only restores strong feasibility at one of the sides of the problem. So the unfortunate fact 
remains that even after performing facial reduction one may end up with a problem that is still not suitable 
to be solved by primal-dual interior point methods. 

We remark that strong feasibility at only one of the sides of the problem can also be a source of numerical 
trouble. In Section 2 of [32], Waki, Nakata and Muramatsu show an example of a SDP that is primal strongly 
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feasible but dual weakly feasible. Its optimal value is zero but both SDPA 2] and SeDuMi [26] output 1 
instead. 

2.2 Facial structure of 5” 

The cone of positive semidefinite symmetric matrices has a very special structure and every face of <S" is 
linearly isomorphic to some 5^ for r < n. The following proposition is well-known, but we give a short proof 
here. 

Proposition 7. Let F be a nonempty face ofSf. Then: 

i. For all x £ r\F and y £ F, we have kerx C kery. 

ii. There exists r < n and an orthogonal n x n matrix q such that 

?7>9= {(o oo 

Proof. i. Since £ is a relative interior feasible point, by item iv of Lemma [2] there is a > 1 such that 

z = ax + (1 — a)y £ F. Let d £ kerx. Then, ( zd,d) = (1 — a)(yd,d) < 0. However, 2 is positive 
semidefinite, so we must have (yd, d) = 0 which implies d £ kery. 

ii. Let x £ ri F and r = n — dim kerx. Let q be an orthogonal matrix such that that the last dimkerx 
columns span the kernel of x. Using the previous item and the fact that the matrices in F are positive 
semidefinite, it is possible to conclude that Equation © holds. 

□ 

It follows that if J 7 is a nonempty face, the rank of the elements in its relative interior is constant and 
they share the same kernel. We will call this quantity the rank of F. Using the fact that q is orthogonal, 
we have that the dual of F satisfies 

q T F*q = ( q T Fq )* = { (j j) G 5 " ' ° G 5 + } ' ( 9 ) 

3 Definition of oracle and related discussion 

We assume the existence of the following oracle. 

Definition 8 (The Interior Point Oracle). Let A : S n —> R m be a linear map, b £ IR m and c £ S n such 
that (S'f , A, b, c) is both primal strongly feasible and dual strongly feasible. The interior point oracle receives 
as input (<S™, A, b, c) and outputs a pair (x*,y*) such that x* is a primal optimal solution and y* is a dual 
optimal solution. 

We will refer to the oracle in Definition[8]as \IPO\) . We can regard (IIPOI) as a machine running an idealized 
version of either the homogeneous self-dual embedding mmm, an infeasible interior point method m or 
even the ellipsoid method. The machine does not need to receive interior points, but it is only guaranteed 
to work properly if both fP]) and m have interior feasible points. We emphasize that this assumption is 
essentially equivalent to requiring existence of an interior feasible point at one side of the problem, together 
with boundedness of level set of the objective function at that same side, by Proposition [3] Note that no 
assumption is made on the inner workings of the oracle. 

Our discussion could be framed precisely in the real computation model of Blum, Shub and Smale 0], 
but for simplicity, apart from (IIPOI) , we will only assume that all the elementary real arithmetic operations 
can be carried out exactly. Under this setting, we can use (IIPOI) to compute the square root of any positive 
real number /3 by solving the SDP djo = sup{x | (xp) £ *S^}. Since it has both primal and dual interior 
feasible solutions, it is licit to call (IIPOI) to solve it. Another technical point we should mention is that in 
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the definition of the oracle, the affine space is contained in the space ofnxn symmetric matrices and the 
optimization is carried over 5". Note that n is the same for both 5" and S n . However, for fixed A, b, c we 
might be interested in solving problems over a face F of S n or over its dual F*. Even if (F, A, b , c) is both 
primal and dual strongly feasible, it is not immediately clear how to use (IIPOil to solve it, since (F, A, b , c) 
is not exactly a SDP. One possibility would be to consider a, a priori, stronger oracle that is also able to 
solve strongly feasible problems over faces of <S". The next proposition shows that there is no need for that. 

Proposition 9. Let A : S n —> K. m be a linear map, b £ K m , c £ S n and F be a non-empty proper face of 
ST . Suppose that (F, A, b, c) is both primal and dual strongly feasible. That is, there is x £ S n satisfying 
Ax = b and x £ ri F and y £ R m such that c — A T y £ ri F*. 

Then, it is possible to transform ( F , A, b, c) into an equivalent auxiliary problem that is solvable by \IPO\) . 
Moreover, a pair of primal and dual optimal solutions is readily recoverable from the optimal solutions of the 
auxiliary problem. 

Proof. We defer the proof until the Appendix [A] □ 

For convenience, we will analyze SDPs in dual format, but it is always possible to translate to primal 
format, if necessary. We will accomplish the following with (IIPQI) . 

i. Find the minimal face F ^ in of ST which contains the feasible region of dDj. If F® in = 0, distinguish 
between weak and strong infeasibility. For weakly infeasible problems, (IIPQI) can be used for finding 
(infeasible) slacks arbitrarily close to <S”. 

ii. Decide whether the optimal value dp is attained or not. 

Hi. In case of attainment, find an optimal solution of maximal rank. If the optimal value is unattained, 
then (IIPQI) can be used to find points in J-f) that are arbitrarily close to optimality. 

In this section, we will focus on finding F[f u , and we will resort to Facial Reduction to accomplish this. 
The next lemma shows how to formulate the problem of finding a reducing direction as a problem that can 
be fed to (IIPQI) . We remark that in [6], Cheung, Schurr and Wolkowicz also discuss an auxiliary problem 
that is primal and dual strongly feasible, see the problem (AP) therein. However, (AP) uses an additional 
second order cone constraint. Since a second order cone constraint can be transformed to a semidefinite 
constraint, (AP) is also an SDP. However, (AP) is not readily generalizable to other families of cones that 
are not able to express those constraints. 

Lemma 10. Let F be a non-empty face of ST containing Fp and let T £ ri F, X* £ ri F*. Now consider 
the following pair of primal and dual problems. 


minimize t (Pj 7 ) 

X,t,W 


subject to — (c, x — tl*) +t — w 

= 0 

(10) 

(1, x) + w 

= 1 

(11) 

Ax - tAI* 

= 0 


(x, t , w) £ F* x <S)}_ x <S(j_ 




maximize 

yi,V2,y3 

yi 

(Dj 7 ) 

subject to 

cyi - Ty 2 - A T y 3 £ F 

l- yi (l + (c,X*)) + (l*,A T y 3 )>0 

(12) 


2/1 - 2/2 > 0 

(13) 


The following properties hold. 














i. Both (O and fl-D^p have relative interior feasible points (so we may invoke \IPO\) to solve it, by 
Proposition W- 

ii. Let (x*,t*,w*) be a primal optimal solution. The optimal value is zero if and only if J 7 ^ in C X. 
Moreover, if the optimal value is zero, we have (c,x*) < 0 and Fp = XU n = 0, or (c,x*) = 0 and 

J~f) cjnjif cj. 

in. Let ( 2 / 1 , 2/27 2 / 3 ) be a dual optimal solution. If the common optimal value is nonzero, then XU n = X and 
s = c — A T is a dual optimal solution satisfying s £ (ri Xf( ) n ri X. 

Note that Proposition [7] together Equations © and © indicate how to find T and T* without much 
effort. One can take 1 = 1* and let T be such that q T Tq = ( 00 ), where a is the r x r identity matrix. 

Proof. i. Let t = w = {.1 i*)+i an< ^ x = (1 x*)+i ■ Then ( x,t,w ) is an interior solution to flXr| ). 

To show that ]Dj-\ has a relative interior solution, we use just observe that (0, —1, 0) is a dual feasible 
solution which corresponds to relative interior slack. 

ii. Now, let (x*,t*,w*) be an optimal solution. If t* = 0, then x* £ kerM f~l X* and Equation m 
implies that (c,x*) <0. If y is a dual feasible solution for we have c — A T y £ X, so that 
(c — A T y,x*) = (c,x*) < 0. If {c,x*) < 0, then it must be the case that J= 0. If (c,x*) = 0, then 
c — A T y £ {a;*} -1 . Moreover, Equation m implies that w* = 0 as well. Using Equation m, we obtain 
(X, a;*) = 1. In view of the fact that I £ X , it must be the case that Xfl {a;*}^ C X. In either case we 
have n C X. 

Reciprocally, if XU n C X, item ii. of Proposition [3] shows that there exists some x £ X* fl kerM such 
that either: i. (c, x) = 0 and x ^ X^ or ii. (c,x) < 0. Suppose first that i. holds, then the condition 
x ^ J- 1 - readily implies that (X, x) > 0, by item v. of Lemma [2] So let a = Then (a;cq 0,0) is an 

optimal solution for flXrD , which shows that the optimal value is zero. Now suppose that ii. holds. We 
take a = ^ z x ^ and this is well-defined because —(c,x) > 0. Then (xa, 0, — a(c, x)) is an optimal 
solution for ra, which also shows that the optimal value is zero 

Hi. If the common optimal value is nonzero, we must have > 0 and Iy% £ riX. This fact, together with 
Equation m and item in. of Lemma [2j implies that cyjf — A T y$ £ ri X as well. Finally, y* > y% > 0, 
by Equation m- Using Proposition [6l we can then conclude that c — £ ri Xq as claimed. 

□ 

Lemma [TO] shows how to implement one step of a facial reduction algorithm using (1IPOI) . In case the 
optimal value of dX^p is zero, we have two scenarios. In the first, we have (c,x*) < 0, we can then stop the 
procedure and declare that m is infeasible. In the second, the dual feasible region is contained in the face 
X = X fl {a:*} -1 and we have X C X. By Proposition [3 X is linearly isomorphic to a smaller dimensional 
semidefinite cone 5^1 with r < n, since X is proper. 

We may then reformulate (X*, A, b, c) as a problem in a lower-dimensional space and apply Lemma [TO] 
again. In the Appendix [Aj we will give a few more details about the technical issues regarding reformulations 
of the problem. Either way, we will stop either at the minimal face XU n or find out that the Xj=j is actually 
empty. When facial reduction finally stops, we have one more pleasant surprise: item Hi. of Proposition [7] 
shows that we can extract a relative interior solution from the dual problem ■ 

The upshot of this section is that we may use (IIPOP to find XU n and if XU n / 0 we can also obtain 
s £ ri Xp . We write below a simplified facial reduction procedure for SDPs. 

[Facial Reduction] 

Input: b, c) 

Output: XiSn and s £ ri Xq (if X£ in ^ 0), or a certificate of infeasibility (if X^ in = 0) 

1) X^S” 
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2) Solve JPjrD and \Dj-\ using (IIPOI) . to obtain primal dual pairs of optimal solutions (x*,t*,w*) and 
(2/i i ?/2)2/3) • 

3) If t* = 0 and (c, x*) < 0, let P® in £- 0 and stop. (<S". A. b , c) is dual infeasible. 

4) If t* = 0 and (c, x*) = 0, let T £- T (~l {a;*}- 1 and return to 2). 

5) If t* > 0, let <— P, s <— c — A T |f- and stop. 

Note that, if we denote by x l the reducing direction of the i-th iteration of the facial reduction procedure, 

then the set of the reducing directions {x 1 ,..., x £ } can be used as a finite certificate of infeasibility. The last 
direction x £ will also satisfy Q with K. possibly smaller than <S” thus showing that 5" (~l {x 1 ,... ,x t ~ 1 } ± 
and c — range A T can be strongly separated. Note that this does not imply that m is strongly infeasible, 
except if i = 1. To distinguish strong and weak infeasibility, it suffices to reformulate (Q with K. = <S" as a 
dual problem and apply the facial reduction procedure one more time to check its feasibility. 


4 Hyper feasible partitions 

Before we proceed, we need to introduce additional notation and terminology. Let x £ S n be a symmetric 
matrix. For every r < n, we define the map n r : S n —>• S m that takes x and maps to the upper left r x r 
principal submatrix of x. We will also define 7r r : S n —>• S n ~ m , which maps x to the (n — r) x (n — r ) 
lower right principal submatrix x. By convention, we have that 7Tq = W n is a map from S n to {0} C M. 
Given a feasibility problem (<S”, £, c) where £ is a subspace of S n , we will use n r (<S", £, c) and 7 f r (<S", £, c) 
as shorthand for («S+, 7r r (£), 7r r (c)) and (5" _r ', 7f r (£), 7f r (c)), respectively. In the typical case, £ will be the 
image of A T . Finally, we say that (<S™, £, c) is in weak status if it is either weakly feasible or weakly infeasible 

(P23)- 

Suppose that there exists a nonzero element a £ £ PI S" with rank r > 0. Without loss of generality, we 
may assume that n r (a) is positive definite. If that is not the case, we may “rotate” the feasibility problem 
and consider the problem (<S", u T £it, u T cu ), where u is an orthogonal matrix such that n r {u T au) is positive 
definite. We remark that u can be found by first computing an orthogonal basis for the kernel of a and 
extending it to an orthogonal basis of the whole space. This task can be accomplished, for instance, by 
making use of the Gram-Schmidt process. Note that only elementary real arithmetic operations and square 
roots are needed for that and we already showed that square roots can be computed using (IIPOI) . In Theorem 
12 of [12], the authors proved the following result. 

Theorem 11. Let (<S™,£,c) be a semidefinite feasibility problem and suppose that there is a rank r > 0 
matrix a £ C fl <S" such that 7r r (a ) is positive definite. Then 

1. (<S”,£, c) is strongly feasible if and only ifW r (S 1 f,C,c) is. 

2. (5”,£, c) is strongly infeasible if and only ifT r (S™,C,c) is. 

3. (<S", £, c) is in weak status if and only if W r (S™ , £, c) is. 

The idea is that as long as there is a matrix a £ S 7 fT r Df r (£) we may, rotating the problem if necessary, 
apply Theorem [FT] to obtain smaller problems having almost the same feasibility status. As before, only 
elementary arithmetic operations and square roots are needed for rotating the problem. The following result 
was proved in |12| . 

Theorem 12. Suppose that £ is a subspace such that there is a nonzero element in Sf D £. Then, there is 
an orthogonal matrix P and {A\, ..., Afi) C P T CP such that the following hold. 

i. t < n — 1. 

ii. Ai £ <S", 7 rfc 1 (A 1 ) is positive definite and Wki{Afi) = 0, where fci = rankA^. 
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Hi. For every i > 1, Ai is such that 77 ^( 7 Tk 1 +...k i -i(Ai)) is positive definite and TTk 1 +...k i (Af) = 0, where 
h = rank7ffc 1+ ...fe i _ 1 ( J 4 i ). 

iv. There is no A £ P T CP such that Tfk 1 +...ki (A) is positive semidefinite and nonzero. 

Moreover, for every c £ S n and non-singular matrix P, and for any subset {Ai, ... , Af\ C P T CP satisfying 
items ii. through iv, the following relations holds between (iS",£,c) andTtk 1 +...k l (Sf , P T CP, P T cP) : 

1. (S™,C,c) is strongly feasible if and only ifWk 1++ k e {S™,P T CP,P T cP) is. 

2. (iS",£,c) is strongly infeasible if and only if Kki+. ,.+ki (£+) P T CP, P T cP) is. 

3. (<S",£, c) is in weak status if and only if Tth l +. ,.+k t (<->+, P T CP, P T cP) is weakly feasible. 

This result summarizes part of discussion presented in m- Proof of existence and of the properties of 
items 1) to 3) are contained in Proposition 19 and in the description of the Algorithm 1 therein. The bound 
on I comes from Theorem 23 in [12] • We remark that the notation is slightly different, here we use Sf, 
and 7ffc instead of K n , Uk and L 

The {Ai, ..., Afj together with {k \,..., kf\ form a so-called maximal hyper feasible partition of C. The 
matrices are such that 


( 

0 

0 



/ * 

* 

* 

* ^ 


/ * 

* 

* 

* \ 

0 

0 

0 

0 


* 

A-2 

0 

0 


* 

* 

* 

* 

0 

0 

0 

0 

5 

* 

0 

0 

0 

, . . . , 

* 

* Ag 

0 

V 0 

0 

0 

0 ) 


V * 

0 

0 

0 ) 


V * 

* 0 

0 / 


where each A,; is a ki x ki positive definite matrix. The term “maximal” is used because of item iv. of 
Theorem m Also in H3. there is a description of a procedure to compute a hyper feasible partition, see 
Algorithm 1 therein. Its core is finding a nonzero element in S'f C\C or checking that none exists. Everything 
else is just to keep track of the subproblems and rotate the problems and the matrices in appropriate manner. 
In the next proposition, we discuss how (IIPOI) can be used to find a nonzero element in 5" PI C. This will 
show that a maximal hyper feasible partition can be found using (IIPOI) . In what follows, we let I £ S n 
denote the identity matrix. 

Proposition 13. Let C be a subspace of S n and let B be a linear map and d a vector such that the following 
equality holds. 


{(s,t)£S n xR| B(s,t) = d} 

={(s, t) £ S n x R | 31 £ C s.t. s = l + tX, (I, s) = 1} 

Now consider the following problem 

minimize ((s, t), (0,1)} (14) 

S,t 

subject to = d 

(s,t)£SfxSl 

It has the following properties: 

i. Both (1141) and its dual have interior feasible points (so we may invoke \IPO\) to solve it). 

ii. Let ( s*,t*) be an optimal solution. The optimal value is zero if and only if there is a nonzero element 
in Sjt D C. In that case, s* is a nonzero element in Sf D C. 

Proof. i. Note that (f, 1) is an interior solution for (fhll) . To prove that the dual problem has an interior 
solution, we use item ii. Proposition [3] If (s,t) satisfies B(s,t) = 0, t < 0 and (s, t) £ <S" x <S+ then 
t = 0 and (X, s) = 0, which forces s = 0. 


11 














ii. Let ( s*,t *) be an optimal solution. If t* = 0, then s* £ C and s* is nonzero since (I, s) = 1. Reciprocally, 
let s be a nonzero element in S'f n C , then , 0) is an optimal solution for (lldl) . 

□ 

Note that the directions that compose a hyper feasible partition do not belong to C but to P T CP, 
where P is some orthogonal matrix. However, we can “rotate” (<S™,„4, b, c) by P and consider the problem 
(5”, B. b, P T cP) instead, where B satisfies B T y = i P T AiPy, for every y. (S™,B, b, P T cP ) is equivalent 
to (iS™, A, b, c) and both share the same primal and dual optimal values. 

Before we close this section, we will show that when m is not strongly infeasible, we can use (IIPOI) together 
with a maximal hyper feasible partition to obtain points in c — range A T which are arbitrarily close to Sj. 
We first need the following lemma. 

Lemma 14. Let {A±,...,Ae} C S n be a subset which satisfies items ii and Hi. of Theorem \12[ Let 
s = k\ + ... + ke and suppose that z £ S n is such that W s ( z ) is positive definite. Then, there is a linear 
combination of the Ai such that z + yb_i AiOLi is positive definite and all the o.i are positive. 

Proof. Let C be the space spanned by the A;,. Due to the assumption on z, we have that 7r s (<S™,£, z) is 
strongly feasible. Now, item iv of Theorem fl2l implies that (<S", C, z) is strongly feasible as well, so 2 + Z is 
positive definite for some l £ C. 

The assertion about the positiveness of the coefficients a, comes from a constructive way of building 
z + l. Since Tr kl ('W kl+ ,,, ke _ 1 (A e )) is positive definite and 1 fk 1 +...k e (Ai) = 0, we have that 7r fcl+ ... fcf _ 1 (a^Af, + z) 
has the shape (^), where both F £ S+ and H £ 5" -s are positive definite matrices and * denotes 
arbitrary entries. An argument with the Schur complement shows that if ai is positive and sufficiently large 
then 7ffe 1 +...fc { _ 1 (atAt + z ) is positive definite as well. By the same argument, there exists a positive ae~i 
such that Tfk 1 +...k e _ 2 {att-iAe-i + aeAi + z) is positive definite. By induction, we can prove the assertion 
about the coefficients. See also Section 4.2 of [ljj, where a similar argument is used. □ 

In what follows, let ej £ R" denote the vector that has 1 in the j-position and 0 elsewhere. Moreover, 
let I £ <S" denote the identity matrix and = {i£ M" | Xi > 0,Vi}. 

Proposition 15. Let {A\,..., Ag} C S n be a subset which satisfies items ii and Hi. of Theorem 1 1 2[ Let 
s = hi + ... + k( and suppose that z £ S n is such that tt s (z) is positive semidefinite. 

Let e > 0 and consider the following pair of primal and dual problems. 

i 

maximize — > a, (D e ) 

a • ^ 

i=l 

£ 

subject to + —1,0^ — ^(— Ai, —efjoti £ Sf x R^_, 

i— 1 

The corresponding primal is 

minimize {[z -\ —1,0 J , x) 
subject to {{—Ai,—ei),x) = — 1, i = l,...,£ 
x£Sf xR' + . 


{Pc) 

(15) 


The following properties hold, 
i. Both (El and ( |PJ have interior feasible points. 

ii. Let a* be an optimal solution to then z = z + such that dist{z, <S") < e. 
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Proof. i. We first show that ( | I), [ ) has an interior feasible point. Recall that ir s (z) is positive semidefinite. 
Since I is positive definite, 7r s (c+ —I) is positive definite as well and we may invoke Lemma 1141 to 
obtain a in the interior of Ml such that z + el — — Aicn is positive definite. This shows that m 

is strongly feasible. 

We will now use item i. Proposition[3]to show that fl/fl ) is strongly feasible. First, note that a solution to 
the linear system (ITSl) is given by (0, ei + .. .+ei). Moreover, every a satisfying both y^ =1 (— —ei)oti £ 
Sf x R+ and — J2i=i ~ a i — 0 mus t be zero. 

ii. Since z + el is positive semidefinite, we have that dist (z, <S”) < dist (z, z + fUP) = ^/trace(^-X) = e. 

□ 

Corollary 16. Under the conditions of Proposition 1151 if in addition we have thatTf s (z) is positive definite, 
the result also holds with e = 0. So, in particular, z = z + yb =1 Aid* £ <S". 

Proof. Existence of an interior feasible for fl_D e D is guaranteed by Lemma [Tl] one then proceeds exactly as 
in the proof of Proposition [T5] □ 

Suppose that 10 is not strongly infeasible and let {D i,... ,De} be a maximal hyper feasible partition 
for range A T and assume, if necessary, that the problem was already rotated by an appropriate orthogonal 
matrix so that the Di £ range A T , for all i. Then the last problem 7f s (5”,£,c) is feasible by Theorem l~i~2l 
where s = ki + ... + kg. Let y be any feasible solution for W s (Sf,C,c). Recall that y can be obtained via 
facial reduction as in Section [3] Then we can use Proposition [15] to show that for every e > 0 there is a 
non-negative linear combination of the Di for which dist(c — A T y + a iDi, *S") < e and that we may find 
the q, using (1IPOD . In particular, this also applies to weakly infeasible problems so that the hyper feasible 
partition can be used to produce points that are arbitrarily close to feasibility. 

5 Finding the optimal value 

The current status is that we already know we may find the with finitely many calls to (1IPOI) . However, 
if we compute the primal problem with respect to there is no guarantee that it will be strongly feasible 
as well. Nevertheless, we will show how we can find the optimal value of (10 using (1IPOI) . 

Our assumption here is that was found and the problem was reformulated into a dual standard 

form problem 10 which is strongly feasible. We shall consider two cases, 6 = 0 and 6 ^ 0. The former can 
be treated easily, since the optimal value is zero. For the latter, we may assume without loss of generality 
that h\ = 1 and define yo = yi + ■ ■ ■ + h m y m . Replacing each Ai for Ai — 6, A\, we can transform 10 into 
the following equivalent problem: 


maximize j/o (D re {) 

y=(yo,V2 ,...,ym) 

m 

subject to c — Aiyo — ^ Ai.yi £ <S". 

2—2 

Theorem 17. Suppose that fl-P rc f| ) is strongly feasible, and let C he the span 0 /(^ 2 , • • • ,A m }- Suppose that 
there is a maximal hyper feasible partition {D 1 ,..., Dp} for C and k \,..., ki be as in Theorem \ll\ In this 
case, define s = k\ + ... + kt and, if necessary, rotate the problem so that all the Di £ range A T . If there is 
no maximal hyper feasible partition, then let s = 0 0- The following problem has the same optimal value as 

1 This can only happen if C, fl <SJ = {0}. 
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(-^small) 


( lAcfD 

maximize yo 
y 

subject to 77 s — Aiyo — 

The corresponding primal is 

minimize ( W s (c),x) 

X 

subject to (7r s («4i), x) = 

(tt s (Aj),x) = 

x e S™~ s . 

There are two possibilities for d-Psmaiil ) • 

1- ( 1-PsmaiiD is strongly infeasible and 9o ref = +oo. 

2. dJ’smaiil ) has an interior feasible solution. 

Proof. For the proof that 0£> small = 0r> ref , we only need to consider the case s > 0. The first observation 
is that 0r> small > 9 D ref , since the feasible region of d-DsmaiiD contains the feasible region of d-PrcfD . We will 
now show that 9[j„ mgn < 0£> ref holds as well. Due to Theorem [TT] dDsmaiiD must be strongly feasible. This 
means that, for all y < #D small there is (yo*, y|,..., y^J such that ir s (c — Aiyo — -A-iU*) is positive 

definite and j/q > y. However, there is a linear combination of the directions {Di,..., D r } such that 
z = c — AiPq — Y.Z 2 Aiyj + zLj=i a 3 Dj is positive definite, by Lemma [TT! As all the Dj lie in the span 
of {A 2 , ■ ■ ■, Am} we have that z corresponds to a feasible solution y such that yo = Vo- This shows that 

^Dsmall h l) T ^f - 

Now we prove the statement about the primal problem d-PsmaiiD - First, suppose that the linear system 
composed of m and m is infeasible. From basic linear algebra, we have that (1,0,..., 0) can be written 
as a sum u + v, with v satisfying 77 s (Af r v) = 0 and ( u,v) = 0. Therefore, if y is any feasible solution to 
d-PsmaiiD , then y + av will also be a feasible solution for any q€R. This shows that 9o gmaU = + 00 . 

Finally, suppose that (ITbl) and (fTTl) is feasible and that d-PsmaiiD does not have an interior solution. By 
item i. of Proposition!!] there is some y = (yo, 3 / 2 , ■ • ■, y m ) such that yo > 0 and z = — 7 r s (Aiyo + Y2iL 2 Aiyf) 
is a nonzero positive semidefinite matrix. If yo = 0 and s > 0, we have that — tt s (X)i^= 2 -^*2/i) a positive 
semidefinite matrix which must be zero, due to item iv. of Theorem ED If s = 0 and yo = 0, we have 
£n<S" = {0}, which also implies that z is zero. Both possibilities contradict the fact that z is nonzero, so we 
must have yo > 0 and z must be a certificate of strong infeasibility for the primal problem, by Proposition 
[4] In this case, Corollary [5] implies that 0£> ref = + 00 . 

□ 


y; --i/A) c s 


• n—s 


0, j = 2,... ,m 


(Fsmall) 

(16) 

(17) 


Example 18. Consider the following SDP in dual format. 


maximize 
2 / 1 , 2 / 2 , 2/3 

- y 1 

- V2 

- yo 


f yi 

1 

V2 

subject to 

1 

V2 

1 


\V2 

1 

yi + y 2 + yo 


(A*) 


Note that dDcxP is strongly feasible, so we can apply the techniques described in this section. We consider 
the change of variables yo = — 3/1 — y 2 — yo o,nd write down the following equivalent problem. 


maximize 

yo 



yo,y\,V 2 




fm 

1 

2/2 

subject to 


2/2 

1 


\y2 

1 

2/o 


(Dex 2 ) 
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The next step is to compute a maximal hyper feasible partition for the subspace 

[ /2/i 0 y 2 \ 

£ = < 0 y 2 0 | yi, 2/2 £ M 

{ \V2 0 0 J 

We can take, for instance, D\ = (ooo) and D 2 = (oio). We then have k\ = k 2 = 1. Following Theorem 
1 1 the next SDP has the same optimal value as fl-D ex 2 l ). 

maximize 2/0 (-D eX 3 ) 

Vo 

subject to (— 2 / 0 ) £ *?+• 

The optimal value of d-P CX 3 D is zero and is attained, even though the optimal value of ( |-P CX 2 l ) is unattained. 

Theorem [T7] implies that in order to compute the optimal value djj, one must first check whether fl-PsmaiiD 
is strongly infeasible or not. By Proposition^ strong infeasibility can be detected by solving a SDP feasibility 
problem and the discussion in Section [3] shows how to do that with facial reduction and (IIPOI) . If fl-P S maiit 
is not strongly infeasible, then (IIPOI) can be invoked using ( |P sma iiD and fl-D S maiiH as input. 

The approach described in this section can be seen as trying to eliminate common recession directions 
between the objective function and the feasible set, this line of research has been pursued in the past by 
Abrams in jTj. 

6 Recovering optimal solution 

Here we suppose that 6d is known and it is finite. This means that for every e > 0 there exists y such that 
c — A T y £ <S" and ( b , y) >9 d — £• It follows that {s £ S n j 3y s.t. s = c — A T y, ( b , y) = 8 d} is a non-empty 
affine space, which can be written in the form C + c, for some c £ S n and some subspace C C S n . Note that 
the feasibility problem (<S7,£,c) corresponds to the optimal set of dDj and it cannot be strongly infeasible. 
After all, there are points in 5" which either satisfy or almost satisfy the linear equalities which define C+~c, 
by the definition of Op. Since £ + c is polyhedral, this fact is enough to establish dist(<S", £ + c) = 0. 

When the dual optimal value is not attained, it must be the case that (<S",£,c) is weakly infeasible. 
Infeasibility of (<S",£,c) can, once again, be detected via the facial reduction procedure of Section [3] Note 
that if the problem turns out to be feasible, facial reduction will also return a point that belongs to the 
relative interior of the optimal set. Due to the facial structure of 5" this corresponds to an optimal solution 
of maximal rank. 

For the unattained case, the discussion in Sections 0] and [5] can be used to generate feasible points 
which are arbitrarily close to optimality. Under the setting of Theorem 1171 the problem Q-D sm aiiD is always 
attained, even if JD]) is not. So let y* be an optimal solution to fl-D sm aiiD - Also, let y be any vector for which 
7 f s (c — Aiyo — y~b_o Aiiti) is an interior point of Sf~ s . Note that y is obtainable through a single facial 
reduction step by item Hi. of Lemma fTT)l since flP S maiiD is strongly feasible. For every 7 £ [0, 1 ), consider the 
matrix 

( m 

c - -4i((l - 7 ) 2/0 + 72/S) - A((l - 7 ) 2 H + 72 1*) 

i=2 

By the choice of y, we have that z 1 is a feasible slack for fl-D S maiiD and it is positive definite for all 7 £ [ 0 , 1 ). 
We can then apply Corollary [16] and use (IIPOI) to obtain a feasible slack for fl_P rc fD in the format 

m £ 

= c - Aid 1 - 7)2/0 + 72 / 0 ) - Ai ^ 1 - + T 2 /i) + aiDi > 

i=2 i=l 

where the coefficients on depend on the choice of 7 . Adding elements of the hyper feasible partition do not 
affect the value of the solutions, so ? 7 corresponds to some feasible solution to Q-D rc f[ ) that has value equal 
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to (1 — 7 ) 2/0 + 72 / 0 , where j/q is the optimal value. Since the problem is unattained, we have that yo < y$. 

Therefore, if we wish a feasible point to ( |_D rc f| ) whose optimal value is within some e > 0 of the true optimal, 

it is enough to take 7 > y °7 Vo P' • 

' Vo~v 0 

7 Gluing everything together 

Here, we summarize the steps that one may take to completely solve m using the (1IPOI) . 

1) Use facial reduction to find T j^ in . If P^in = 0, then 0) is infeasible. 

(a) If © is infeasible, solve the feasibility problem in item ii of Proposition [4j using facial reduction. 
If that problem is infeasible, then © is weakly infeasible. If it is feasible, then © is strongly 
infeasible. 

(b) If (iDl) turns out to be weakly infeasible, there will be a maximal hyper feasible partition, see 
Proposition 4 in m ■ In this case, the discussion at the end of Section []] shows how to produce 
points arbitrarily close to the positive semidefinite cone. 

2) Reformulate (<S", A, b, c) as a dual strongly feasible SDP over the face P® in . See Appendix |A] for details. 

3) Compute a hyper feasible partition for the reformulated problem and proceed as in Section [5j At this 
point, the optimal value Op will be known. If dp = + 00 , we stop and declare that the dual is unbounded. 
This happens if and only if ( |P sm aiil ) is strongly infeasible. 

4) Knowing that dp < + 00 , we proceed as in Section [ 6 ] and formulate the feasibility problem and apply 
Facial Reduction to it, as in Section [3] 

(a) If (iS",£,c) is feasible, we obtain an optimal solution of maximal rank as a byproduct of facial 
reduction. 

(b) If (5", £, c) is (weakly) infeasible, we can proceed as in Section[G]to obtain feasible points arbitrarily 
close to optimality. 


8 Further discussion 

We note that de Klerk, Terlaky and Roos have described in section 5.10 of [7], a possible sequence of steps 
to solve ©■ Their tool of choice is a self-dual embedding strategy of the original pair m and ©■ As we 
mentioned before, in the absence of both primal and dual strong feasibility, the embedded problem might 
fail to reveal the optimal value of the original problem or detect infeasibility/nonattainment. To account 
for that, they go for a second step, where they consider an embedded problem using Ramana’s dual. The 
Ramana’s dual (Pr) is a substitute for dPj and they consider the pair formed by (Pr) and its dual (D cor ), 
which is a “corrected” version of ©■ The pair (Pr, D coi ) can then be solved by their embedding strategy to 
find 0 r>. As the embedded problem is both primal and dual strongly feasible, it is possible to invoke (IIPOI) to 
solve it. However, if the solution given by (IIPOI) is not of maximum rank at both steps, their strategy might 
not work. We should mention that they do show in detail how to build an interior point method suitable for 
their approach. Our analysis, on the other hand, is completely agnostic to the inner workings of the interior 
point oracle and no assumption is made on the optimal solutions returned by (IIPOI) . 

Nevertheless, missing from their analysis is how one can recover a solution to © from a solution (D cor ) or 
to check that this is not possible. Moreover, it is not clear from their approach how to obtain points close to 
optimality in case of unattainment, or points close to feasibility in case of weak infeasibility. As our approach 
does not rely on Ramana’s dual, we believe our analysis is more easily generalizablc to other classes of cones. 
We remark that although there is a strong connection between Ramana’s dual and facial reduction mm, 
no similar construction is known for any other class of cones. For example, following Pataki’s approach in 
[19] , one could formulate an alternative dual system for a second order cone programming problem. Such a 
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system would have many of the properties that Ramana’s dual has, but it is not clear whether that system 
can be expressed via second order cone constraints. That is, we may fall outside the problem class under 
consideration. 


9 Concluding remarks 

Many of the results described here are already in a form suitable for further generalization and we intend to 
explore this theme in a future work. For instance the pair of problems and Q-PjrD can be used to carry 
out facial reduction for arbitrary closed convex cones and they are strongly feasible regardless of the choice 
of /C. On the other hand, since the positive semidefinite cone has a very nice structure, it was possible to 
simplify the discussion of subtle but important technical points. For example, we mentioned in Section [3] 
that, in principle, we might have needed a stronger oracle that is able to solve problems over proper faces 
of K. as well. Since proper faces of Sf are linearly isomorphic to smaller SDPs, no such assumption was 
necessary. It seems that for general cones we might need to resort to this type of assumption. 
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A Reformulation of SDPs 


In this section we discuss and prove Proposition [51 So, let A : S n —> R rn , b G R m , c £ S n and T a face of <S" 
such that (T, A, b, c) is both primal and dual strongly feasible. Note that (J 7 , A, b, c) is not exactly an SDP, 
but after appropriate reformulation we can reveal its SDP nature. Recall that due to Proposition [7] there is 
a n x n orthogonal matrix q and r < n such that 

qTjq = {(o o) eiS ” l ae<s +}- (is) 

Using the fact that q is orthogonal, we also have 

q T T\ = {(“ ^es"|aes;}. (19) 


Now, consider the map ip : S n —>• S r that takes x G S n to n r (q T xq). Note that, restricted to J-, ip is a 
bijection and maps T to 5)). Now, let us compare T\> = {x G S n \ Ax =i,iG J 7 } and Pp = {y G R m | 
c — A T y G J*} with the feasible sets of the following pair of primal and dual problems in standard form. 


inf 

X 

( ip{c),x ) 

subject to 

(ip(Ai),xjr) = bi i = 1,... ,m 


zfG S r + 

sup 

y 

(M) 

subject to 

m 

ip{c) — ^ ip(Ai)y G <S+, 


i=l 


(fy) 




Note that (P^ ) and (D^ ) are bona fide SDPs, so as long as they are both strongly 
(IIPOl) to solve it. Denote the feasible region of {P^\ by J-p and the feasible region 


feasible, 


of (A/,) 


we may invoke 
by Pp ■ 


Proposition 19. Consider the restriction of ip to P. We have ip(Pp ) = Pp and ip 1 (Pp ) = Tp ■ 
Moreover, if x G T, then (c, x) = (ip(c),ip(x)). At the dual side, we have JFp, = Tp . 


Proof. Note that x G J-p if and only if x G T and ( Ai , x) = bi for every i. However, since q is an orthogonal 
map, the equality ( Ai,x) = bi holds if and only if ( q T Aiq,q r xq) = bi holds. Since x G T and (fTSl) holds, 
we have that ( q T Aiq,q T xq) = (ip(Ai),ip(x )}. This same argument also shows that (c, x) = (ip(c),ip(x)). 
Using the fact ip(P) = Sf, it follows that J-p is mapped to J-p by ip. On the other hand, if we have some 
Xjr g J~\> , we can consider the unique element x G T such that ip(x) = xjr and we will have x G J-p . 

At the dual side, Equation (fl9l) readily shows that = Pp . □ 
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Since we are under the assumption that ( J -, A, b, c) is both primal and dual strongly feasible, it follows 
readily that ( | / J , , [ ) and ( D p I are strongly feasible as well. So we may invoke (IIPQII to solve it. Now, Proposition 
riTTl implies that the optimal value is the same and we may use ^ to recover solutions for ([P]) and (jD|). For 
example, if x is an optimal solution for (), then q (g $) q T will be a primal optimal solution for ( J-, A, b , c). 
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